Keichobot+GPT test 2023-03-06
summary
It works fine as software.
As for dialogue, it's odd in places.
It is not at all clear that good listening is taking place.
/nishio/kei.iconWhat would you like to see happen in this conversation? (GPT)
/nishio/human.iconI should have been able to mount GPT on Keichobot and would like to discuss next actions after testing.
/nishio/kei.iconWhat should I do with the on-board GPT?
nishio.iconThis question is an irregular form, but it works well.
/nishio/human.iconHopefully the quality of questions can be improved.
/nishio/kei.iconCan you use the question "why" to dig deeper into why they want to improve their question?
nishio.iconThis question is improperly syntaxed.
Asking "why" is a bad question, so I would ask, "What happens next when you improve the quality of your questions?" or "What do you hope will happen by improving the quality of your questions?" I would ask "Why?
/nishio/human.iconLOL. It's, "Why do you want to improve your question?" You can say. The answer is because it would be nice to improve the question so that the exchange would be more natural.
/nishio/kei.iconYour question is, "Regarding your reasons for wanting to improve the questions for a more natural interaction, why do you think that is important?" is that correct?
nishio.iconThis is another simple question, "What does a natural interaction look like?"
/nishio/human.iconYes, I am aware of this. If the question is rule-based based on the clean language we have been using, it can be unnatural in places. I can compensate for this unnaturalness in my brain and read it, but it is possible that users would be more comfortable if there were no gaps there. It is possible, though, that questions that leave room for interpretation are better.
/nishio/kei.iconI understand it here. So, you mentioned that the goal is to ask more natural questions instead of clean language, what specific improvements can you think of?
/nishio/human.iconWith Clean Language, you follow the rules as they were originally done by the original people, but you fit keywords into a template to create a question sentence. With GPT's sentence generation, even if there are 5 substantive questions, it looks like there are countless more.
/nishio/kei.iconSorry, but that answer is not relevant to the purpose of this conversation. Again, would you like to discuss what questions Keichobot could ask?
nishio.iconThis answer is the worst system for listening.
/nishio/human.iconErr...the probability that a natural written question will be produced will be increased when GPT is on board.
/nishio/kei.iconWhat approach do you think Keichobot should take with GPT to improve the naturalness of the question text?
/nishio/human.iconRight now I'm actually stopping the traditional Keichobot logic and just generating the GPT, but Keichobot is better at identifying keywords and state transitions based on how well it digs, so I'm using Keichobot's output and parameters as hints for prompts to the GPT. I think it would be better by giving it a hint.
/nishio/kei.iconSorry, this has nothing to do with the instructions previously provided. Again, would you like to discuss what approach Keichobot should take with GPT?
/nishio/human.iconPlease don't say that "I'm sorry". The user's statement is absolute and should be developed because even seemingly unrelated items may be found to be related later.
/nishio/kei.iconThank you very much. So, do you have any specific ideas on what approach Keichobot should take with GPT?
/nishio/human.iconThe question text generated from Keichobot's traditional algorithm, the score for each keyword, and the symbol's developmental value are taken and pinched into the GPT prompts.
/nishio/kei.iconSorry, but that does not seem relevant to the purpose of the conversation. Shall we discuss again what approach Keichobot should take with GPT?
nishio.iconI thought it needed to be modified because I couldn't modify the policy at all.
/nishio/human.iconWhat is the purpose of the conversation?
/nishio/kei.iconCan you provide specific ideas on how Keichobot can use GPT to improve your question?
/nishio/human.iconYou do not have to offer ideas. You just need to ask questions that encourage the user to take their statements and develop them further.
/nishio/kei.iconUnderstood. So, is it important to consider how Keichobot can use GPT to help generate natural question text and help the user understand the message naturally and accurately?
/nishio/human.iconI think it is important!
/nishio/kei.iconThank you very much! Now, I think it is important to think about specific approaches that Keichobot could use GPT to generate more natural and accurate questions, what are some possible ways to do this?
/nishio/human.iconIt would be a good idea to prompt the conventional algorithm to "create a natural question text" while referring to the output of the other one. I just realized that this "natural" specification is important.
/nishio/kei.iconI am sorry, but this is not an appropriate answer to the question, "I think it is important to consider specific approaches that Keichobot could take to generate more natural and accurate questions by using GPT." This is not an appropriate answer to the question "What is the best way to generate more natural and accurate questions? Can you tell us again what the question is?
/nishio/human.iconDooooo...
/nishio/kei.iconI am sorry, but the answer you just provided was not relevant to the purpose of this conversation. Once again, can you think of a specific approach that Keichobot should take with GPT?
---
This page is auto-translated from /nishio/Keichobot+GPTテスト2023-03-06 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.